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Abstract 

We propose a parametric family of measures of fairness in alloca- 
tions of TU-cooperative games. Their definition is based on general- 
ized Renyi Entropy, is related to the Cowell-Kuga generalized entropy 
indices in welfare economics, and aims to parallel the spirit of the no- 
tion of price of anarchy in the case of convex TU-cooperative games. 

Since computing these indices is NP-complete in general, we first 
upper bound the performance of a "reverse greedy" algorithm for ap- 
proximately computing worst-case fairness. The result provides a gen- 
eral additive error guarantee in terms of two (problem dependent) 
packing constants. We then particularize this result to the class of 
induced subset games. For such games computing worst-case fairness 
is NP-complete, and the additive guarantee constant can be explicitly 
computed. We compare this result to the performance of an alternate 
algorithm based on "biased orientations" . 
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1 Introduction 



A central issue in cooperative game theory is coming up with a "fair" allo- 
cation of a total cost to a set of agents that respects coalitional rationality. 
The Shapley value [Rot 88j provides the classical, well-understood approach 
to this problem. But it is not the only possible solution, nor is it appropri- 
ate from all points of view. Indeed, computing the Shapley value is often 
intractable [DP 94] . Imposing the Shapley value in a distributed multiagent 
setting (though possible in principle) may be even more problematic, as it 
requires the use of a (centralized) mechanism that incentivizes the players 
to commit to accepting this cost-sharing method. Furthermore, there are 
settings where using the Shapley value may simply be inappropriate. This 
is, for instance, the case of coalitions with a dynamically evolving structure, 
or that of games in which the Shapley value is not in the core (hence it 
is not immune against coalitional deviations). Finally, the Shapley value 
may be incompatible with the presence of prior social constraints that favor 
alternative social arrangements (e.g. egalitarianism |DR89j ). 

We do not mean by the previous discussion that one could replace the 
Shapley value by any alternative allocation in the core: it simply may be the 
case that no single solution concept is appropriate in all circumstances. 

In noncooperative game theory the seminal work of Roughgarden and 
Tardos [RT02[ IRou05[ IRT07] on the price of anarchy provides a powerful 
intuition that could have an analog in cooperative settings as well. Instead 
of advocating any particular solution to the problem of equilibrium selection, 
their price of anarchy measure takes a pessimistic perspective, quantifying 
the degradation in overall performance due to uncoordinated behavior, mea- 
sured on the worst equilibrium. This circumvents the problem of equilibrium 
selection by providing (pessimistic) guarantees that are valid for any rational 
solution. 

In this paper we propose an approach with a similar philosophy for coop- 
erative games. Rather than attempting to postulate any particular solution 
of such a game, we investigate the fairness of an arbitrary "rational" cost 
allocation (where in this paper we define rationality as membership in the 
core). We propose not a single measure, but a parametric family of measures 
of fairness, based on variations on the concept of Renyi entropy and fruitfully 
used before as measures of inequality in welfare economics [UK81J. 

The structure of the paper is as follows: in Section 2 we briefly review 
some relevant concepts in cooperative game theory, information theory and 
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combinatorial optimization. We then introduce in Section 3 our paramet- 
ric family of measures of fairness. In Section 4 we first present a "reverse 
greedy" algorithm for the problem of minimizing the worst-case fairness of 
a convex cooperative game. We give a general result on the performance of 
this algorithm. In section 5 we particularize our discussion to the class of 
induced subgraph games of Deng and Papadimitriou [DP94J: first we apply 
the general result in the previous section to obtain an explicit bound on the 
performance of the reverse greedy algorithm. Then we display a connection 
with a weighted version of the minimum entropy orientation problem from 
[CFJ08b] that allows us to obtain a bound that is better for some particular 
values of the parameter A. 

2 Preliminaries 

We will work in the framework of Cooperative Game Theory (for a recent 
survey of the relevant literature from a Computer Science perspective see 
|CEWllj ). We will assume knowledge of basic concepts from this literature 
such as cooperative game, core, concavity/ convexity of a cooperative game, 
imputation, Shapley value and so on. 

We need the following notion adapted from |AKV 08j : 

Definition 1. A solution concept q is a function that assigns to every convex 
cooperative game T an imputation q = q(T). It is a core concept if q(T) 6 
core(T) for every such game T. 

We will also assume knowledge of computational complexity. A standard 
recent reference is [AB09J. 

We recall the notion of Renyi entropy of a probability distribution: 

Definition 2. lCT91f For any discrete random variable X with probability 
mass function p = {pi)i and for any real A > 0, A ^ 1 the Renyi entropy of 
order A of X is defined as: 




(1) 
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We can complete this definition for A = 1 by the usual Shannon entropy 
H(X) = H 1 (X) = -J2^og 2 p l - (2) 

i 

Without loss of generality we will assume in the sequel that one can 
convert any vector of nonnegative values X into a probability distribution 
by normalization. Without risk of confusion we will use the name X for the 
resulting distribution as well. 

We need the following simple fact, which informally states that stochastic 
domination leads to lower Renyi entropy: 

Lemma 1. Let P = (p 1( . . . ,p i} . . . ,pj, . . . ,p n ) be a probability distribution 
with pi > p 2 > ■ ■ ■ > p n - Let 1 < % < j < n and < e < pj. Defining 
Q = (pi, ... ,pt + e, ... ,pj — e,... , p n ) for any A > we have: 

H X (P) > H X (Q). (3) 



When A = 1 the result was proved in [AU95] (see also [UFJ08b| ). The 
general case follows from investigating (using standard calculus techniques) 
the monotonicity of function f(x) = (x + e) A — x x for x > 0. 

We will highlight the concepts we introduce in this paper on the class of 
induced subgraph games, studied in |DP94j (see also |CEW11|, Top98|). 



Definition 3. [Induced subgraph (IS) games:] We are given a connected 
loopless graph G = (V,E) and a set of integer weights {wi,j)(i,j)<=;E °n the 
edges. Vertices of G are interpreted as players in a cooperative game, that 
may contribute to a coalition the edges they have in common with members 
of their coalition. In other words, given set S C V, the value of coalition S 
is 

v(S)= w ^r W 

{i,j)€E,i,jeS 

In |DP94j it is proved that for nonnegative weights induced subgraph 
games are convex. In what follows we will assume that weights are nonneg- 
ative. In addition we also assume that, for any vertex v G V, the sum of 
weights of its adjacent edges is strictly positive. Otherwise we could simply 
eliminate v from G without changing the problem. 
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Definition 4. Given an instance (G,w) of IS, a cover of (G,w) is a function 
u '. V — y such that u(V) = v(V) and for all S C V, 



That is, a cover is an imputation in the core of the cooperative game (V, v) 
having integer values. The restriction to integers is computationally moti- 
vated, and reasonable in any intended algorithmic application of cooperative 
game theory. 

To apply our result to IS games we need a problem generalizing the min- 
imum entropy orientation problem horn |CFJ0 8b|: 

Definition 5. Consider a connected loopless graph G = (V, E) and a set of 
integer weights (wi,j)(M)e£- 

• An orientation of G is a mapping h : E — » V such that for any e = 
(i,j) E E, h(e) is a vertex of e. Ifh(e) = i we will say that e is oriented 
towards i in h. 

• an orientation h of G is called biased if each edge (i,j) E E with 
v(i) > v(j) is oriented toward i, where the value v(i) := 5] e ^io e is the 
weight sum of all edges adjacent to vertex i. In other words, edges are 
oriented towards the vertex whose weight sum is larger. 

An optimization problem associated to edge orientations is to find an 
orientation h of G that minimizes Renyi entropy of the weights vector: 



(and similarly for A = 1). We will denote this problem by MREWO. 

One can find an approximately solution to any instance of this problem 
by means of the Greedy algorithm (formally discussed in the unweighted case 
in [CFJ08bt ICD08] ). described informally as follows: 

• Select a vertex i E V that maximizes value v(i). 

• Orient all edges in G towards i. 

• Delete i and all its adjacent edges from G and proceed recursively. 



u 



(S) := 7 X;«W<«(5). 
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3 The (parametric) worst-case fairness of a 
cooperative game 



We now define the main object of interest, a parametric family of measures 
of fairness for cost allocations of a cooperative game T = (N,v). They are 
indexed by: 

• A positive real A. 

• A solution concept q, yielding vector q(T) 6 r!^'. Intuitively vector 
q(F) represents a baseline "standard of fairness" to which all other ele- 
ments are held. Our measures attempt to evaluate the largest possible 
discrepancy between an imputation in the core and q(T). 

To define our measure we need the following concepts: 

Definition 6. Let P = (p^ and Q = (qi) be two distributions and A > 0. 

1. The Renyi divergence of order A is defined by: 



The following is the discrete version of the Gibbs inequality (Lemma 1 



Lemma 2. For any A > the discrete X-Renyi relative entropy has a non- 
negative value. 





2. The discrete Renyi relative entropy of order A is: 




from [LYZ05J): 



hx[P,Q] > 0. 
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For the proof see the Appendix. 

Though they do not generally yield metrics, informational divergence 
measures have a significant history of use as indicators of " similarity" between 
two probability distributions. They are pseudometrics and have a number of 
other desirable properties that have made them applicable to problems such 
as learning and classification (to give just one example we refer to [U1196] ) . 
This observation enables us to finally give the following definition of worst- 
case fairness: 

Definition 7. Given cooperative game T = (N, v) and real number A > the 
A-worst-case fairness of game V with respect to solution concept q is defined 
as 

Fair\(T,q) = sup{D\(x\\q(T)) : x G coreiT) fl Z N }. 

Definition [7] obviously depends on the choice of the baseline solution con- 
cept q. At least several special cases make sense: 

1. strictly egalitarian worst-case fairness: q(T) is the uniform vector 
U(i) = 4& for all i G N. That is, we benchmark all solutions against 
the uniform distribution. 

Though it could seem at first somewhat controversial from a modeling 
standpoint, as it requires a very strong form of equality, the study of this 
measure makes sense at least from a mechanism design point of view. 
Namely, in the case of convex/ concave games, particularly interest- 
ing examples of imputations in the core arise from group-strategyproof 
mechanisms or, equivalently, cross-monotonic sharing schemes (see [Mou99] 
and Chapter 15 of [N RTV07] ). Requiring cross- monotonicity yields 
(according to [IMM08] ) a "plausible notion of equity". A natural is- 
sue raised by this scenario is the potential inequity in cost assignments 
induced by the use of cross-monotonic mechanisms. The strictly egali- 
tarian worst-case fairness offers a pessimistic measure of this inequity. 

The study of strictly egalitarian worst-case fairness can be further justi- 
fied on technical grounds: the computational tractability of the uniform 
distribution makes the derivation of algorithmic bounds on worst-case 
fairness easier than the general case. Furthermore, as we will see, we 
can derive weaker bounds for some alternate core concepts from bounds 
on strictly egalitarian worst-case fairness. 
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A 




C 



x + y > 2 
core(G) : < x + z > 4 
y + z > 6 
k z,y,s > 0. 



a; + y + z = 12 



Figure 1: (a) An IS game with three players; (b) Its core. 

2. marginalist worst-case fairness: in this case q is the probability distri- 
bution obtained from the Shapley value by normalization. One should, 
of course, not expect this measure to be efficiently computable given 
that the Shapley index is hard to compute. 

3. egalitarian worst-case fairness: in this case q corresponds to the egali- 
tarian solution of Dutta and Ray [DR89] . Alternately one could use the 
equivalent Arin and Inarra solution concept [AInOl] that is a core con- 
cept for convex games. We will not study this measure in the present 
paper. 

Example 1. Consider the induced subgraph game V with three players 
presented in Figure [Qa). The total payoff to be shared between players 
is 12 = 2 + 4 + 6. The core of V is given by the system of equations in 
Figure d^b). 

The Shapley value is (according to the computation in [DP94]) Sh = 
(3; 4; 5). Furthermore, by performing simple symbolic computations one can 
show the following: 

• There are a total of 57 integer imputations (covers) in the core. Of these 
six are extremal (i.e. corners of the polygon geometrically describing 
the core). 

• There are two covers in the core maximizing strictly egalitarian worst- 
case fairness (for A = 1). They are (2; 0; 10) and (0; 2; 10) respectively. 
Worst-case fairness Fairi(Y ,U) is approximately 0.934. 
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• On the other hand there exists an unique optimal cover in the case 
of marginalist worst-case fairness : X = (4;8;0). The corresponding 
worst-case fairness Fairi(T, Sh) is approximately 0.805. 

Thus employing the Shapley value as our standard of fairness of general 
cost allocations in the core is, at least in this game, more fair than imposing 
perfect equality. 

3.1 Further comments 

We have limited our choices to imputations with integer values. Though 
certainly non-standard (and potentially controversial from a "pure" game- 
theoretic perspective), we feel that such a restriction is warranted in any 
algorithmic result on computational game theory. Indeed, "real-life" mon- 
etary payments are not continuous but discrete. We believe that it is not 
unnatural to impose such a restriction on imputations in a paper dealing 
with algorithmic aspects. 

The problem of computing the strictly egalitarian worst-case fairness has 
an especially tractable interpretation. In this case maximizing Renyi diver- 
gence is equivalent to the problem of minimizing Renyi entropy. A more 
limited connection between divergence and entropy holds even in the general 
case. Given distribution R = (r»), denote r max = max{rj : j G supp(R)}, 
f m in — min{rj : j G supp(R)} and define 



the nonuniformity of distribution R. 

Lemma 3. Let P,Q,R be probability distributions and A > 0. We have: 



H x (Q)-H x (P)-nu(R) < D X (P\\R) - D X (Q\\R) < H X (Q) - H X (P) +nu(R) 



Computing a cover x of a cooperative game T = (N, v) that witnesses 
the value of the A-worst-case fairness Fair x (T, q) has, when q is the uniform 
distribution an alternative combinatorial description relying on concepts of 
submodular optimization [GLS93j . In this setting a convex cooperative game 





Proof. See Appendix. 



□ 



□ 
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r = (N, v) maps to an instance of the supermodular Set Cover problem. 
The more frequent problem, that of submodular set cover |Wol82t [FujOO 
corresponds to the dual of the cooperative game T, that is to the game 
r* = (N,v*), with v*(S) = v(N) - v(N \ S). As games T and T* have the 
same core, the measure Fair\ can be computed with respect to the convex 
game V* instead of V. 

Finding a cover realizing optimal value Fair\(T, U) is a natural general- 
ization of a extension (studied in |CD08j ) of the minimum entropy set cover 
problem [HK051 ICFJ08aj . This problem specializes to induced subgraph 
games as follows: 

Definition 8. [Minimum Renyi Entropy IS] (MREIS): 

[GIVEN:] An instance (G, w) of IS, and a real number A G M+, A ^ 1. 
[TO FIND:] A cover u of (G,w) that minimizes : 



H x (u) 



1 



A 



log 



Liev 



u(V) 



Replacing H\ by Shannon entropy Hi in the above definition we get the 
minimum entropy induced subset problem. 

Another version of MREIS involves fractional covers. We no longer in- 
sist on the integrality condition in Definition HJ Instead we allow imputations 
to be real- valued. Clearly, this results in a larger solution set. 



4 Results 

Many results related to submodular optimization analyze the performance 
of the GREEDY algorithm. For supermodular (convex) games, this doesn't 
quite make sense: assigning the first element i its payoff v({i}) does not 
take into account the fact that the contribution of player i increases with the 
coalition, being largest for the coalition \ {i}. In other words v({i}) < 
v(N) — v(N \{i}), and, to create an imbalanced allocation we should assign 
player i its Utopia payoff (that is the right-hand quantity, rather than the 
left-hand). This leads to considering the ReverseGreedy algorithm displayed 
below. 

Example 2. Consider the setting of Example [TJ The ReverseGreedy algo- 
rithm computes one of the covers (0; 2; 10) or (2; 0; 10) (optimal in the case 
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ReverseGreedy: 

INPUT : A game T = (TV, /) 

y:=0; 

A := N; 

While there exists e E A with f(A) - f(A \ {e}) > 
choose i r e A that maximizes f{A) — f(A \ {i r } 
(breaking ties arbitrarily); 
y ir : =f(A)-f(A\{i r }); 
A:=A\{i r }; 

OUTPUT : Solution Y = (y^ieN- 



Figure 2: The ReverseGreedy algorithm 



of egalitarian worst-case fairness). The computed cover depends on the tie- 
breaking rule between the first two nodes. Indeed, the algorithm first selects 
node C, allocating its utopia value 4 + 6 = 10. Then it selects one of A and 
B in an arbitrary order. 

The ReverseGreedy algorithm has an especially attractive interpretation 
via game duality: ReverseGreeedy on game V simply corresponds by duality 
to the Greedy algorithm applied on the dual game T*. 

4.1 Main result 

In this section we give our main result, a bound on the performance of the 
ReverseGreedy algorithm in approximating the strictly egalitarian worst-case 
fairness. That is we consider the case when q = U, the uniform distribution. 
To do so we have to introduce some notation. Specifically: 

1. We will denote by / the number of iterations of the ReverseGreedy 
algorithm. 

2. For 1 < r < I denote by i r the element chosen at stage r of the 
algorithm. Let W r = . . . , i r }, A r = U \ W r and A r be the value of 
element yi r set at stage r. 
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We now introduce a quantity, the "impact of j on z r ", that will play a 
fundamental role in our results below: 

Definition 9. For any 1 < r < I we define the impact of j on i r by 

4 = [/(A--0 - f(A r )} - [/(A-i \ {j}) - f(A r \ {j})} . (7) 

Proposition 1. For any 1 < r < I and 1 < j < in we have a\, > 0. 

Proof. Note that A r _\ = A r U {v}. Thus when j = i r or i r ^ j (jL A r _i the 
second term is zero, and the result follows directly from the monotonicity of 
function /. Assume now that i r ^ j G A r -i, thus j G A r . Define S = A r 
and T = A T _\ \ {j}. Then S U T = v4 r _i, S fl T = A r \ {j}, and we employ 
the supermodularity of function /. □ □ 

Given an optimal solution X = {Xj), we will break it down into a large 
number of components Z-j. G Z as presented in equations ([H]) and ([HD below: 

X, = ^^,Vj'G[m] (8) 

r=l 

< Zl < o? r . (9) 

Intuitively Z J r is the part of the optimal solution Xj that can be assigned 
to cover "set i r " . This explains the newly introduced constants: first, one 
cannot allocate more than the total of Xj. Second, one cannot allocate to 
any "set v" more than "its intersection with Xj" . 

Definition 10. Given concave game V 

• Let a = a(r) the smallest positive value such that for some cover X 
in the core minimizing Fair\(T), one can define quantities Z^ so that 
inequalities 

m 

^Zl<a- A r (10) 

3=1 

hold for any 1 < r < I. 

• Let j3 = /3(r) the largest positive value such that for some cover X 
in the core minimizing Fair\(T), one can define quantities Z^ r so that 
inequalities 

m 

P-A r <J24 (11) 

i=i 

hold for any 1 < r < I. 
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Proposition 2. For any convex game T we have 

f3(T) < 1 < a(T). 



Proof. We prove the first inequality, the second is proved in an entirely similar 
manner. 

Sum all equations ffTTj) for all r — 1, . . . , I: 
The left-hand side is 

i 

r=l 

by the ReverseGreedy algorithm. 
Similarly, the right-hand side is 

l / m \ m / I \ m 

E =^='» 

r=l \j=l J j=l \r=l / j=l 

The result follows. □ □ 

Our main result gives an upper bound applicable to all convex cooperative 
games: 

Theorem 1. Given a convex cooperative game V the ReverseGreedy algo- 
rithm produces a cover RG satisfying 

• For any < A < 1 

H X (RG) < H x (OPT) + ^-l_log 2 (/?A). (12) 

• For any A > 1 

H\(RG) < H x (OPT) + log 2 (aA). (13) 
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Corollary 1. The cover RG produced by the Reverse Greedy algorithm satis- 
fies 



where 5\(T) 



D X (RG || U) > Fair x (T, U) - 5 X (T) (14) 

^logaGSA), z/0<A<l 
^ T log 2 (a;A), if\>l 

Proof. Follows directly from Theorem [T] and Lemma ODD 

Observation 1. By Proposition [H both constants in the upper bounds of 
Theorem^ are nonnegative. 

Observation 2. If at least one of parameters a or (3 are equal to 1 then we 
can complete the result to the case A = 1 by taking the limit X — > 1, yielding 

H(RG) < H(OPT) + log 2 (e). (15) 

4.2 Proof of Theorem U 

Proof. Let OPT = (X,) je[m ] and RG = (yi)ie[n]- 

For 1 < r < I we will use the shorthand UJ = Xj — Ylk=i We a ^ so 
define 11® = Xj. For any fixed j, sequence (UJ) is decreasing with r. On the 
other hand UJ" 1 - UJ = Z>. 

By the greedy choice we infer y ir = A r = /(A r _i) — f(A r ) for any 1 < 
r < I, with Hi = for other values of i. 

We have A = N. Thus 

A r > /(A-i) - /(4-i \ 0'}) = 

= /(AT) - {f(N) - /(A-i)] " f(N \ {j}) + [/(iV \ {j}) - /(A-i \ {j})] 

r— 1 r— 1 

= /(AO - - - /(# \ {j}) + \ {j})- 

r— 1 r—l 

- /(^ \ 0'})] > / w - m \ {j}) -J24> x i - E a i- ( 16 ) 

fc=l k=l 

At the last step we used inequality Xj < f(N) — f(N \ {j}), which 
follows from core membership (in)equalities J2keN\{j} > f(N\ {j}) and 

14 



Case A > 1: 

First we use inequality Y^T=i Z J r < a • A r as follows: 

/ l l / m 



r=l 



r=l 



r=l \j=l 



Applying inequality ( JIBjl we get: 



r-1 



A-l 



EE^^EE^ 'i-E^. = E 

r=l j=l r=l j=l \ fc=l / j=l 



r=l 



Using identity Z-j = C/J — C/J 1 we have: 

ml ml 

EE^r 1 )^ 1 = EE^J - r ; 'h'7 ') A 1 = (*) 

j=l r=l j=l r=l 

Transforming the difference into a sum of ones and taking into account 
that x x ~ x is increasing we obtain: 



E 



E E «7 





m 






l)A-lj 


aE 


E 


' E H 






r=l 


\t.u;+i ) _ 



From Uj = Xj it follows that: 



E 



E E 

r=l \k=UV+l 



Xi 



E E* M 

i=i \fc=i 



Putting things together, using A > 1 and standard calculus we have: 

l m j Xj \ m ~y~ \ i m 

.Eaj^E E*"UEf 4E4 

r=l j=l \k=l J ]=! j=l 
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Taking the logarithm and dividing by 1 — A < yields: 

or, equivalently, by the definition of Renyi entropy: 

H X (RG) < H x (OPT) + ^-L_log(aA) 

The proof is similar in the case < A < 1. We use instead the definition 
of (5. Also the standard calculus inequality changes its direction. □ □ 

5 The worst-case fairness of Induced Subgraph 
Games 

In this section we particularize our general result on worst-case fairness to 
the case of Induced Subgraph Games (problem MREIS). An easy first ob- 
servation is that computing the worst-case fairness of this class of games is 
computationally intractable: 

Theorem 2. For any A > the following decision problems is NP-complete: 

• Given an induced subgraph game T = (G, w) with nonnegative weights 
and a constant r\ > 0, does Fair\(T,U) > r\ ? That is, is there any 
cover x G core(T) with D\(x, U) > rj ? 

We believe that similar result is true for the marginalist worst-case fair- 
ness as well. However, we weren't able to prove it and leave it as an intriguing 
open problem (see the final section for further comments). 

Given Theorem |2] (proved in the Appendix) we need to consider approx- 
imation algorithms. We next give explicit upper bounds on strictly egalitar- 
ian and marginalist worst-case fairness for induced subgraph games. First 
we prove a more explicit version of Corollary [1] for such games. We then 
consider the target distribution Sh obtained from the Shapley value of an in- 
duced subgraph game T (see Theorem 1 in jDP94] ) by normalization. In this 
case we compare the performance of the cover RG given by the ReverseG- 
reedy algorithm to that of a cover BI corresponding to a biased orientation 
(Definition EJ. 
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Theorem 3. Given an induced subgraph game F = (G, w) and A > 

1. The ReverseGreedy algorithm produces a cover RG satisfying 

H x (Sh) - H x (OPT) < [H x (Sh) - H X (RG)) + ^ log 2 (A). (17) 

2. Consider any cover B I corresponding to a biased orientation of instance 
(G,w) of MREWO. It satisfies: 

H x (Sh) - H x (OPT) < I [H x {Sh) - H X (BI)] + 1. (18) 

Corollary 2. In the setting of the previous result we have: 

1. For strictly egalitarian worst-case fairness: 

D X (RG || U) > Fatr x (T,U) - ^-l_log 2 (A) 

2. For marginalist worst-case fairness: 

D X (RG || Sh) > Fair x (T, Sh) - log 2 (A) - nu(Sh) (19) 

A — 1 

and 

D X (BI || Sh) > A ■ Fair x (T, Sh) - (1 + A) ■ nu(Sh) - A (20) 

Proof. Follows directly from Theorem |3] and Lemma El □ □ 

We note that for marginalist worst-case fairness the second bound may 
be slightly better when A ~ 1 . Indeed, in the limit A — » 1 term -^-j-log 2 (A) 
tends to log 2 (e) fa 1.442 . . ., while A ~ 1. This shows that the best of the 
two guarantees in equations ( TE?|) and f[2"0"|) may depend on the precise value 
of constant A (and, of course, other features of the instance at hand). 
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5.1 Proof of Theorem 0.1 



The basis of our proof is the following result, that relates the problem of 
computing a cover in an induced subgraph game to problem MREWO as 
follows: 

Lemma 4. Given an induced subgraph game V = (G, w) the following are 
true: 

1. The cover produced by the ReverseGreedy algorithm coincides with the 
solution produced by the Greedy algorithm on T, seen as an instance of 
problem MREWO. 

2. The optimal fractional solution of V yields an optimal solution of in- 
stance T of problem MREWO and conversely. 

Proof. 1. Consider a fixed step i of the ReverseGreedy algorithm for prob- 
lem T. At this step ReverseGreedy chooses a vertex Vi such that its 
choice maximizes the marginal decrease in coalition cost. That is, the 
sum of weights of edges adjacent to Vi and another node still in the 
coalition is the largest. 

Formally, at step i we delete vertex V{ G Vi-\ and obtain the graph 
Gt = (V h Ei) with Vi = \ {vi} and E x = E(V{). The marginal 
decrease to maximize is: 



(note that Gq = G.) 

Similarly, given instance (G, w) of problem MREWO the Greedy algo- 
rithm (discussed at the end of Section [2]) chooses at step i a vertex u f 
maximizing the sum of weights of all adjacent, not yet oriented, edges. 
It orients all such edges towards t> j. This step is thus formally identical 
to the corresponding choice of ReverseGreedy on instance T of MREIS. 

2. Fractional covers Z = (zi, z 2 , . . . , z n ) of an IS game (imputations in the 
core) can be characterized as follows: 




w 




(21) 
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where r^j are real numbers in the range < < 1 with r^- + r 3j j = 1. 

This claim is an easy consequence of the characterization of the core 
of IS games [DP9 4]. and a special case of a more general paradigm 



Lemma 5. Let X = (xi)i be an optimal fractional cover of instance V. 
Without loss of generality reorder the set of vertices so that x\ > x<i > 
■ ■ ■ > x n . Then coefficients from formula l[21\) satisfy: 



for all i,j G V. 

Proof. Consider an arbitrary edge G E. Assume that i < j (the 
opposite case is easily handled via relation r^j + r^j = 1) and ry < 1. 
Define for notational convenience < e < 1 by e = r^j = 1 — r^j. 
With this choice further define X = (xi, . . . , Xj, . . . , £j, . . . , af n ) where 
x~i = Xi + ewij, £j = Xj — ew it j, and x~k = x^ for all other k ^ Note 
that x and x differ just on components i,j. By the previous remark x 
is still an imputation in the core. 

We now apply Lemma [Hand infer that for all A > we have H\(X) > 
H\(X), which contradicts the hypothesis that X had the lowest Renyi 
entropy. □ □ 

The previous result can be interpreted as follows: any optimal solution 
X = (xi)i satisfies Xi = ^ eE i< jW{i,j)i where the elements of X are 
listed in nonincreasing order. 

With this result in hand, we construct a solution Y = (y\, . . . ,y n ) 
of instance T of MREWO by orienting all the edges (i,j) with i < j 
towards the vertex with a lower index. Y arises from an edge orientation 
u given by u((i,j)) = i for all i < j. Thus 



|DIN99j . 




1, ifi<3 
0, ifi>j. 




(i,j)£E,i<j 
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Clearly, the objective values of X and Y are the same. 

Conversely, let Y = {yiji be an optimal cover of an instance V of 
MREWO, with associated orientation u and yi = J2 e eu- 1 (i) w e- We 
assume that vertices are ordered to respect y\ > y% > ■ • • > y n , thus if 
i < j we have u(i,j) = i. 

From Y we can define a solution X of an instance T of MREIS as in 
equation ( l2Tj) with 

Ji, {i,j)eu-\i) 

10, otherwise. 

Therefore 

(i,j)eE {i,j)du- l {i) 

and solutions X and Y have again the same objective values. 

Together these two facts show that optima of a common instance of 
the two problems are the same, and the proof is complete. □ 

□ 

To complete the proof of Theorem El 1 , by Theorem [1] all we need to prove 
is the following 

Lemma 6. For all IS games T = (G, w) one can construct a system of 
parameters (Z-j.) from Equation (Q|), witnessing equality a(T) = (3(F) = 1. 

Proof. The argument is a slight generalization of the analysis given in [BI12] 
for the Minimum Entropy Orientation Problem |CFJ08bl ICFJ12j . 

Lemma 7. Given any IS game (G, w) we have 

{Wi r ,j, if % T ^ j, (ir, j) e E,j e A r 
A r , ifi r = j (22) 
0, otherwise, 

where A r is the value computed by the algorithm ReverseGreedy at stage r. 
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Proof. A simple application of formulas (]3J) and (17j) : in this case, for any set 
SCV ' ' 

f(S) := v(S) = Yl 

e£SxS 

Therefore /(A r _i) — f(A r ) is the sum of weights w e of edges e between i r 
and another node in A r . On the other hand the value of expression /(A r _i \ 
/(A- \{j}) depends on j: 

• It is zero if i r = j , 

• It is /(A r _i) — f(A r ) when j ^ i r and j ^ A r , 

• Otherwise, it is equal to the sum of weights w e of edges e between i r and 
another node in A r \ {j}. In particular this is equal to /(A r _i) — f(A r ) 
when j is not adjacent to i r . 

The result follows. □ □ 

Lemma [7] allows us to define a system of coefficients (Z-j.) satisfying for 
every r : 

$>;? = A r . (23) 
j 

Together with the Definition fflUj) and Proposition (T5]) this will witness 
the fact that a(T) = /3(T) = 1. 

In the construction we will see covers OPT and RG as edge orientations 
in the weighted graph (G, w). We will use the names OPT and RG for these 
orientations as well. 

To enforce equation (|23|) we note that A r is the sum of weights of all edges 
oriented towards i r in RG. Intuitively we will redistribute this amount among 
coefficients Z 3 r with 1 < j < m. We do this by comparing orientations OPT 
and RG. Edges are considered in the order given by the Greedy algorithm. 

• Start with Zj, = for all r and j. 

• Run algorithm Greedy that constructs orientation RG, updating coef- 
ficients during the algorithm: 

• At each stage r: after choice of vertex i r we consider edges (i r ,j) 
oriented by Greedy towards i r . There are two possibilities: 
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1. (i r ,j) is oriented towards i r in both RG and OPT. We set Z l r r = 

2. (i r ,j) is oriented differently in OPT and RG. We let Z ] r = u>i,.j(= 
a 3 r ) for such edges. 

Note that the total weight assigned at stage r is A r (= a l r r according to 
Lemma [7]) . 

Hence the inequality < Z 3 r < a J r is true for J %y ELS well. □ 



This completes the proof of Theorem [3jl. □ 

□ 

5.2 Proof of Theorem SI 2 

Proof. Let G be an orientation of G = (V, E) of minimal Renyi entropy. 

Denote by OPT = the indegree distribution = -|pr-, where ug(i) 

(as in Definition EJ) is the sum of weights of all edges oriented in ~G* towards 
vertex % 6 V, and W is the sum of all edge weights. 
The Renyi entropy of OPT expands as follows: 



Hx(OPT) =^to& ($>)*) = T3a log2 (E 





') 







T^A log2 ^ E 





1 







Taking into account that x is decreasing for any < A < 1 we infer 



H x {OPT) > 



1- A 



log 2 



1 

W 



max{v(i),v(j)} 
W 



A-1 
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The inequality is true for any A > 1 as well, as x x 1 is now increasing but 
we multiply with negative constant jK-. 
Let be a biased orientation. Thus 



W; 



v(i) > v(j) 

Let BI = (g 4 b )j be its indegree distribution. By the definition of biasedness 
we have: 



w 



l-J 



max{u(i), f (j)} 

max{v(i),v(j)} 
W 



A-l 



A-l 



T^A log2 fe 

Kiev 



w 



W 

A-l 







~v(i)~ 




W _ 


1 



~i A-r 



Deng and Papadimitriou [DP94j proved that the Shapley value of an 
induced subgraph game is s(i) = \ s ^ ij LjW i j = 4r. Thus, the Shapley dis- 
tribution Sh = (si)i of such a game is Si = ^ = 

Hence: 



Hx(OPT)>-^—\ogJj2qt 

\iev 



~2W ■ si 




W 


1 


Si)"- 1 ) 






- 1 
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The difference between entropies of the optimal and Shapley distribution 
can be written as follows: 



H x (q) - H x (s) > -^T log 2 ( £ q\ {s^A - 1 - -L- log 2 ( £ A 

Kiev J \iev J 

^ iog 2 E «. b («.)" + j i° g2 E *? - wi^y E «) 

v ' «ev «ev «ev 

= /i A [SJ, S/i] + i# A (£/) - ^a(^) - 1 

Applying the discrete Gibbs Lemma we infer 

H x (q) - H x (Sh) > j (H X (BI) - H x (Sh)) - 1 

which is what we had to prove, up to multiplication with -1. □ □ 

Conclusions 

The main contribution of this paper was to propose a parametric family of 
measures of worst-case fairness in cooperative settings. Besides the analogy 
with the Cowell-Kuga measures of inequality, a partial possible justification 
of the parametric nature of our family arises from Corollary |2j depending on 
the particular values of A different approximation algorithms may provides 
the better approximation. 

Our analysis raises many open questions: 

• Prove that maximizing marginalist worst-case fairness of IS games is 
NP-complete. We attempted to adapt the approach of |CFJ08b| to 
yield graphs G that are regular (and thus the Shapley value of the 
IS game on G coincides with the uniform distribution). However the 
reduction from |CFJ 08b| seems to produce graphs that are inherently 
non-regular (more precisely, they have vertices with two possible de- 
grees, 3 and 4). Further attempts at modifying the gadgets employed 
in this construction were unsuccessful. Nevertheless, we believe that 
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maximizing marginalist worst-case fairness of IS games is NP-complete 
as well. 

• Investigate the tightness of the upper bounds for approximating marginal- 
istic and other worst-case fairness measures in the case of IS games. 
Our result showed that an additive upper bound could be obtained at 
least for marginalist worst-case fairness. We don't have, however, any 
results concerning the hardness of approximation for this measure. 

• Extend the study of these measures to other convex cooperative games. 
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Appendix: 

Proof of Lemma [2] 

We will apply the classical Holder inequality: 



£/, 9 ,< £/' Eft' 



where (fk)k, (dk)k £ K+, and i, r > 1 with 1/t + 1/r = 1. There are two 
cases: 

Case A > 1 : Setting t — A > 1, r — y^r, /, = p^, ^ = g^ 1 we obtain: 



A-l 
A 



Erf -1 ** < Erf E(«n CT 

Further, taking the logarithm and dividing with the negative number 1 — A 
we get: 



Erf E"? 



A- l "1 

A 



A(l - A) 



L-iog^y-liog £\ 
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Case < A < 1 : We now take t = j > 1, r = ^ > = (g, A Vi)' 
and (7j = g^ 1- ^, therefore: 



A-U A A A(l-A) 



< 



A-l„ \ A \ A 



E («f-vo 



Erf" 



Pi 



.iev 



Si'/ 

l-A 



A(l-A)\ l-A 



l-A 
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equivalent ly 

> (I>, A ) IE* 



A-l 
A 



A 

y 

igy \iev J \iev 



Taking the logarithm and dividing by 1 — A we obtain the inequality. The 
result can be extended to case A = 1 as well by taking the limit. □ 

Proof of Lemma [3] 

Proof. From the definition we have 

D X (P || R) - D X (Q || R) = 

We will reason separately in cases < A < 1 and A > 1. The result 
will however be the same because function x l ~ x is increasing in the first case 
(decreasing in the second) while A — 1 is negative (positive). 

Using inequality r min < r { < r max we infer 

v^-log {^Pi^ma,) 1 -") < D X (P || R) < ^-1-log (^^(r mm )^ A ) 
therefore: 

D X (P || R) - D X (Q || R) > 



= T3T lo S ((w) 1 "" $>f) - ^ log ((r mm ) 1 - A ti) 

i&V i€V 

= - log (r max ) - log ( Pi) + lo S ( r ™«) + T3T lo S ( E ^) 

= H x (Q)-H x (P)-nu(R) 

The other inequality is proved similarly. □ □ 
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Proof of Theorem [2] 



The problem is easily seen to be interreducible to problem MREIS: We have 
Fair\(T, U) > 77 if and only if there exists a cover x of T, seen as an instance 
of MREIS such that H\(x) < \og 2 {n) — rj. Therefore it is enough to prove 
that for any A > problem MREIS is NP-complete. 

Next, Lemma H] interreduces in effect problems MREWO and MREIS. 
For A = 1 problem MREWO has been proved to be NP-complete [CFJ08bj . 
even in the unweighted version (w e = 1 for all e e E(G)). 

The proof of this result encodes an instance <3> of an NP-complete version 
of 1-in-A; SAT into a graph G = (V, E) and an orientation of whose in- 
degree distribution dominates all other probability distributions arising from 
edge orientations of G. We may read the existence of a satisfying assignment 
for $ from the entropy of orientation ~G* . 

The proof can be easily adapted to the general case A > by using Lemma 
[1] which is the generalization of the result employed in jCFJ08b] to all values 
A > 0. The basis is the following modification of Claim 2 in |CFJ08bj . with 
essentially the same proof as the original version. 

Lemma 8. For any A > 0, A ^ 1, the Renyi entropy of the distribution 
corresponding to orientation G (constructed in \CFJ0 8bl) is at most 



with equality if and only if instance $ is satisfiable. 

The conclusion of this argument is that computing lower bounds on 
Fair\(T,U) is NP-complete (the fact that they the problem is in NP is 



log 2 m - 



1 



log 2 (4 A + 7 ■ 3 A - X + 1) /12 



1- A 



trivial). 



□ 
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